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DETAILED ACTION 
Double Patenting 

1. Claim 1 is rejected on the ground of nonstatutory obviousness-type double 
patenting as being unpatentable over claim 1 of U.S. Patent No. 7,109,981 (Damera- 
Venkata) in view of U.S. Pub. 2003/0020809 (Gibbon). Damera-Venkata teaches every 
limitation of claim one except "wherein each of the second set of pixels is centered 
relative to one of the first set of pixels." However, Gibbon teaches "the two resulting 
sub-images are offset by one half of a pixel in both horizontal and vertical directions" 
([0012]). 

It would have been obvious to one of ordinary skill in the art, at the time of the 
invention, to modify Damera-Venkata to include the use of a second set of pixels that 
are centered relative to one of the first set of pixels as taught by Gibbon in order to allow 
"the two sub-images to combine to produce a final image having a greater resolution 
than that provided by the actual pixels" as stated in ([0012], of Gibbon). 

Drawings 

2. The drawings are objected to under 37 CFR 1 .83(a). The drawings must show 
every feature of the invention specified in the claims. Therefore, the "each of the first, 
second, third, and fourth sub-frames comprising a plurality of sub-frames pixel values 
that correspond to a plurality of sub-frames pixels that are centered with respect to a 
plurality of pixels of the image data;" (claim 20) must be shown or the feature(s) 
canceled from the claim(s). No new matter should be entered. 
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Corrected drawing sheets in compliance with 37 CFR 1.121(d) are required in reply 
to the Office action to avoid abandonment of the application. Any amended replacement 
drawing sheet should include all of the figures appearing on the immediate prior version 
of the sheet, even if only one figure is being amended. The figure or figure number of an 
amended drawing should not be labeled as "amended." If a drawing figure is to be 
canceled, the appropriate figure must be removed from the replacement sheet, and 
where necessary, the remaining figures must be renumbered and appropriate changes 
made to the brief description of the several views of the drawings for consistency. 
Additional replacement sheets may be necessary to show the renumbering of the 
remaining figures. Each drawing sheet submitted after the filing date of an application 
must be labeled in the top margin as either "Replacement Sheet" or "New Sheet" 
pursuant to 37 CFR 1.121(d). If the changes are not accepted by the examiner, the 
applicant will be notified and informed of any required corrective action in the next Office 
action. The objection to the drawings will not be held in abeyance. 

Claim Rejections - 35 USC §112 

3. Claim 20 is rejected under 35 U.S.C. 112, first paragraph, as failing to comply 
with the written description requirement. The claim(s) contains subject matter which 
was not described in the specification in such a way as to reasonably convey to one 
skilled in the relevant art that the inventor(s), at the time the application was filed, had 
possession of the claimed invention, "means for generating the first, the second, the 
third, and the fourth sub-frames using the image data, each of the first, second, third, 
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and fourth sub-frames comprising a plurality of sub-frame pixel values that correspond 
to a plurality of sub-frame pixels that are centered with respect to a plurality of pixels of 
the image data; a means for calculating a plurality of simulated image pixel values for a 
simulated image by convolving each of the sub-frame pixel values with at least four 
other sub-frame pixel values; and means for updating the first, the second, the second, 
the third, and the fourth sub-frames in accordance with a difference between the 
simulated image and the image data." (claim 20) 



Claim Rejections - 35 (JSC § 102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 
(b) the invention was patented or described in a printed publication in this or a 

foreign country or in public use or on sale in this country, more than one year prior to 

the date of application for patent in the United States. 

2. Claims 1, 2, and 13 are rejected under 35 U.S.C. 102(b) as being clearly 
anticipated by Gibbon et al. (US PUB 2003/0020809) hereinafter, Gibbon. 

3. As to claim 1, Gibbon teaches receiving image data for the image (fig. 1 "video 
signal"), the image data comprising a first set of pixels (fig. 6 (41)); generating first and 
second sub-frames (figs 13 and 14 [0047]), wherein the first (fig. 13 (R)) and the second 
sub-frames (fig. 13 (L)) comprise a second set of pixels (fig 6 ((51)), wherein each of the 
second set of pixels (fig. 6 (51)) is centered (fig. 6 (41) and (51) [0012] "two resulting 
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sub-images are offset by one half of a pixel in both horizontal and vertical directions") 
relative to one of the first set of pixels (fig. 6 (41)) [0035]; and alternating (abstract 
"alternately projects") between displaying the first sub-frame (abstract "alternately 
projects off-set image sub-fields") in a first position (fig. 6 and fig. 13 (R)) and displaying 
the second sub-frame (fig. 6 and fig. 13 (L) in a second position spatially offset from the 
first position (fig. 6 and fig. 13 [0046-0048]). 

4. As to claim 13, Gibbon teaches a buffer (inherent with DMD) adapted to receive 
image data (fig. 1 "video signal") for the image, the image data comprising a first set of 
pixels (fig. 6 (41)); 

an image processing unit (fig. 7 [0036-0038]) configured to define first (fig. 15 (R), 
second (L), third (R), and fourth (L) sub-frames comprising a second set of pixels (fig. 6 
(51)), wherein each of the second set of pixels (fig. 6 (51)) is centered (fig. 6 (41) and 
(51) [0012] "two resulting sub-images are offset by one half of a pixel in both horizontal 
and vertical directions") on one of the first set of pixels (fig. 6 (41)); and 

a display device (fig. 1) adapted to alternately display (abstract "alternately 
projects") the first sub-frame in a first position (fig. 15 (R)), the second sub-frame (fig. 
15, (L)) in a second position spatially offset from the first position (fig. 15 (R)), the third 
sub-frame in a third position spatially offset from the first position and the second 
position, and the fourth sub-frame (fig. 15 (L)) in a fourth position spatially offset from 
the first position, the second position, and the third position (fig. 13, 14 and 15 [0046- 
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0048]) Examiner notes that in fig 15 the four respective sub-frames (R, L, R, L) are 
spatially offset according to fig. 6. 

5. As to claim 2, Generating a first sub-frame (See Fig. 5, item 33 and Fig 6., item 
41, paragraphs [0034]-[0035] figs 13 and 15(102))), a second sub-frame (See Fig. 5, 
item 33 and Fig 6., item 41, paragraphs [0034]-[0035] figs 13 and 15(102))), such that 
the two resulting sub-images are offset by one half of a pixel in both the horizontal and 
vertical directions, allowing the two sub-images to combine to produce a final image 
having a greater resolution than the that provided by the actual pixels (See Fig. 5, item 
33 and Fig 6., item 41, paragraphs [0012], [0034]-[0035]). 



Claim Rejections - 35 USC § 103 

6. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

7. The factual inquiries set forth in Graham v. John Deere Co., 383 U.S. 1, 148 
USPQ 459 (1966), that are applied for establishing a background for determining 
obviousness under 35 U.S.C. 103(a) are summarized as follows: 

1 . Determining the scope and contents of the prior art. 

2. Ascertaining the differences between the prior art and the claims at issue. 
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3. Resolving the level of ordinary skill in the pertinent art. 

4. Considering objective evidence present in the application indicating 
obviousness or nonobviousness. 

4. Claim 14 is rejected under 35 U.S.C. 103(a) as being unpatentable over Gibbon, 
in view of Groenenboom et. al (US PUB 6,304,245) hereinafter, Groenenboom. 

In regards to claim 14, Gibbon discloses the limitations of claim 13 

Gibbon differs from the claimed invention in that Gibbon does not disclose 
wherein the first set of pixels comprises a plurality of pixels at a first resolution, and 
wherein the second set of pixels comprises a plurality of pixels at a second resolution 
less than the first resolution. 

However, Groenenboom teaches a system and method for "wherein the first set 
of pixels (foreground) comprises a plurality of pixels at a first resolution ("having 
different resolution"), and wherein the second set of pixels comprises a plurality of pixels 
(background) at a second resolution less than the first resolution " (abstract, fig. 5 col. 
3-4, lines 6-25 of Groenenboom). 

It would have been obvious to one of ordinary skill in the art, at the time of the 
invention, to modify Gibbon to include the use of mixing a foreground picture and a 
background picture as taught by Groenenboom in order to mix differing resolutions as 
stated in (col. 1, lines 5-15 of Groenenboom). 
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8. Claims 3-6, 20, 26, and 27-28 are rejected under 35 U.S.C. 103(a) as being 
unpatentable Gibbon et al. (US PUB. 2003/0020809) taken with Carlson et al. (US 
6,650,704), hereinafter, Gibbon and Carlson, respectively. 

9. Relative to claim 3, Gibbon teaches generating images in sub frames (figs 13, 15 
col. [0046], [0050]). 

10. Gibbon fails to teach a simulated image by convolving the first, second, third and 
fourth sub-frame with an interpolation filter. 

1 1 . Carlson teaches a method of processing a low resolution input frames containing 
undersampled views of an optical image to produce a higher quality, higher resolution 
output frame (Abstract). Carlson teaches taking input frames than convolving these 
input frames with working frames, which are fractionally shifted input frames (See Figs 
1, 2 and 5 col. 8, lines 15-32). 

12. It would have been obvious to a person of ordinary skill in the art at the time of 
the inventions to combine Gibbon's image displaying system with the method of 
simulating image by convolving as taught by Carlson in order to provide a high 
resolution quality image, as a single still image, or may produce a series of high 
resolution output frames as a video sequence (col. 4, lines 32-34). 

1 3. As to claim 4,Carlson teaches wherein the interpolating filter comprises a 3X3 
interpolation filter with nine filter coefficients (See col. 16-17, lines 60-4). Examiner 
notes it would have been an obvious matter of design choice to make the interpolating 
filter (fig. 1 (120, 140 and 160) Carlson) and filter coefficients (fig. 1 (120, 140 and 160) 
Carlson) fixed values, since such a modification would have involved a mere change in 
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the size of a component. A change in size is generally recognized as being within the 
level of ordinary skill in the art. In re Rose, 105 USPQ 237 (CCPA 1955). 

14. As to claim 5, see claim 4. 

1 5. As to claim 6, see claim 4. 

16. As to claim 20, Gibbon teaches a means for receiving image data corresponding 
to the image (See paragraphs [0006], [00012]) the means for generating the first, the 
second, the third and the fourth sub-frames using the image data (See Fig. 5, items 33- 
34 and Fig. 6, items 41-51, paragraphs [0034]-[0035] figs 13 and 15). 

17. Gibbon fails to teach convolving each of the sub-frames, having plural pixel 
values, with at least four other sub-frame pixel values. 

18. Carlson teaches a method of processing low-resolution input frames to produce a 
high-resolution output frame (col. 4, lines 29-35). Carlson teaches sampling at sub-pixel 
precision (col. 4, lines 41-45). These low-resolution input frames are convolved with 
shifted blocks called working frames (See col. 8-9, lines 45-15). Carlson also teaches 
convolving with a kernel (See Fig. 9, col. 12-13, lines 60-5) 

1 9. It would have been obvious to a person of ordinary skill in the art at the time of 
the invention to provide to the methodology as taught by Gibbon with the features of 
Carlson in order to provide a high resolution image. 

20. As to claim 23, Carlson teaches a method of processing a low resolution input 
frames containing undersampled views of an optical image to produce a higher quality, 
higher resolution output frame (Abstract). Carlson teaches taking input frames then 
convolving these input frames with "working frames," which are fractionally shifted input 
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frames (See Figs 1 , 2 and 5 col. 8, lines 15-32). It also would have been obvious to one 
skilled in the art to convolve with eight or more sub-pixels, as these sub-pixels are the 
adjacent sub-pixels. 

21. As to claim 26, Gibbon teaches a computer-readable medium, having computer- 
executable instructions for performing a method of generating low resolution sub-frame 
for display at a spatially offset positions to generate the appearance of a high resolution 
image (See paragraphs [0006], [0012]), the system comprising: 

Receiving image data for a plurality of high-resolution images (See paragraphs 
[0006][0012]); 

Generating a plurality of sets of low resolution sub-frames based on image data, 
each set of low resolution sub-frames, first, second, third and fourth sub-frames, 
corresponding to one of the high resolution images (See Fig. 5, items 33-34 and Fig. 6, 
items 41, 51, paragraphs [0034]-[0035]). 

22. Gibbon does not disclose convolving the first, second, third, and fourth sub- 
frames with an interpolating filter. 

23. Carlson teaches in one embodiment interpolation to upsample the resolution 
(See col. 21, lines 25-32). With the coefficients for the interpolation depending on the 
position of the new pixels and old pixels (See col. 21, lines 25-33). These low-resolution 
input frames are convolved with shifted blocks called working frames (See col. 8-9, lines 
45-15). Carlson also teaches convolving with a kernel (See Fig. 9, col. 12-13, lines 60- 
5). 
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24. It would have been obvious to one of ordinary skill in the art at the time of the 
invention to incorporate the methodology of Gibbon with the teachings of Carlson to 
produce a high-resolution image. The size of the interpolation filter and the filter values 
would have been a matter of design choice and obvious to one skilled in the art. 

25. As to claim 27, see claim 4 

26. As to claim 28, see claim 4 

27. Claims 7-12,15, 21-22, 24-25 and 29-33 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over Gibbon in view of Carlson above, and further in view of Young 
et al. (US PUB. 2003/0063190) hereinafter, Young. 

28. As to claim 7, Gibbon and Carlson teach generating images in sub frames (figs 
13, 15 col. [0046], [0050] Gibbon) and Carlson teaches taking input frames than 
convolving these input frames with working frames, which are fractionally shifted input 
frames (See Figs 1, 2 and 5 col. 8, lines 15-32) 

29. Both Gibbon and Carlson, fail to teach a method of generating an error image by 
subtracting the simulated image from the image data. However, Young teaches 
subtraction in first and second sub-frames particularly for error detection (See 
paragraphs [0004], [0042]). 

30. Therefore, it would have been obvious to one skilled in the art to combine the 
method of error image subtracting as taught in Young with the system of Gibbon as 
modified by Carlson because Young's method of inspection can be applied to two 
similar images for error detection. Sub-pixels alignment is often necessary to obtain a 
degree of accuracy ([0002], Young). 
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31. As to claim 8, Gibbon teaches sub frames (figs 13 and 14), and it would have 
been obvious to one skilled in the art to add two images together to generate another 
image. 

32. Claim 9 is the same methods as taught in claims 7 and 3 and rejected for the 
reasons stated above. 

33. As to claims 10-12, see claim 4. 

34. As to claim 15, Carlson teaches generating a third set of pixels by convolving a 
working frame with an input frame (See col. 8, lines 17-28). 

35. As to claim 21 , see claim 7. 

36. As to claims 22 and 25, Carlson teaches a method of varying a number (alpha) to 
trade spatial sharpness for speed of response (See col. 20, lines 40-50). 

37. As to claim 24, see claim 9 

38. As to claim 29, see claim 7 

39. As to claim 30, Young teaches using error detection methods on single images 
and comparing to computer generated data (See paragraph [0042]). 

40. As to claim 31 see claim 9 

41 . As to claims 32-33, see claim 4 

Response to Arguments 



5. 
the 



Applicant's arguments, see claim 14 pg 17-18, filed 4/25/2007, with respect to 
rejection(s) of claim(s) 14 under Gibbon have been fully considered and are 
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persuasive. Therefore, the rejection has been withdrawn. However, upon further 
consideration, a new ground(s) of rejection is made in view of Gibbon in view of 
Groenenboom et al (US PUB 6,304,245). 

6. In regards to claims 1 and 2, applicant argues Gibbon fails to teach "wherein 
each of the second set of pixels is centered relative to one of the first set of pixels." 
Examiner notes that Gibbon's states, "the two resulting sub-images are offset by one 
half of a pixel in both the horizontal and vertical directions" [0012] Thus, Examiner notes 
that when a pixel is offset from another pixel by half a pixel in the vertical and horizontal 
direction, the pixels will be centered relative to one another. 

7. In regards to claim 13, applicant argues Gibbon's fails to teach or suggest ""an 
image processing unit configured to define ... third, and fourth sub-frames" or "a display 
device adapted to alternately display ... the third sub-frame in a third position spatially 
offset from the first position and the second position, and the fourth sub-frame in a 
fourth position spatially offset from the first position, the second position, and the third 
position" Examines notes Gibbon teaches a buffer (inherent with DMD) adapted to 
receive image data (fig. 1 "video signal") for the image, the image data comprising a first 
set of pixels (fig. 6 (41)); 

an image processing unit (fig. 7 [0036-0038]) configured to define first (fig. 15 (R), 
second (L), third (R), and fourth (L) sub-frames comprising a second set of pixels (fig. 6 
(51)), wherein each of the second set of pixels (fig. 6 (51)) is centered (fig. 6 (41) and 
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(51) [0012] "two resulting sub-images are offset by one half of a pixel in both horizontal 
and vertical directions") on one of the first set of pixels (fig. 6 (41)); and 

a display device (fig. 1) adapted to alternately display (abstract "alternately 
projects") the first sub-frame in a first position (fig. 15 (R)), the second sub-frame (fig. 
15, (L)) in a second position spatially offset from the first position (fig. 15 (R)), the third 
sub-frame in a third position spatially offset from the first position and the second 
position, and the fourth sub-frame (fig. 15 (L)) in a fourth position spatially offset from 
the first position, the second position, and the third position (fig. 13, 14 and 15 [0046- 
0048]) Examiner notes that in fig 15 the four respective sub-frames (R, L, R, L) are 
spatially offset according to fig. 6. 

8. In regards to claim 20, applicant argues limitations of claim 20 have not been 
meet for the reasons of claim 1 . However, Gibbon teaches a means for generating (fig. 
15) the first (R), the second (L), the third (R), and the fourth (L) sub-frames using the 
image data[0046-0050], each of the first (R), second(L), third(R), and fourth (L) 
comprising a plurality (fig. 6) of sub-frames pixel values [0047-0050] that correspond to 
a plurality of sub-frames pixels [0047-0050] that are centered (fig. 6 (41) and (51) [0012] 
"two resulting sub-images are offset by one half of a pixel in both horizontal and vertical 
directions") with respect to a plurality of pixels(fig. 6 (41) and (51) of the image data (fig. 
6 and 15...". 
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9. In regards to claim 26, applicant argues that the limitations of claim 26 have not 
been meet for the reasons of claim 1. However, Gibbon teaches generating (fig. 15) first 
(R), second(L), third(R), and fourth(L) sub-frames based on the first image(fig. 15 
prisms 102 is one image) such that each pixel [0035] in each of the (fig. 15) first (R), 
the second (L), the third (R), and the fourth (L) sub-frames is centered (fig. 6 (41) and 
(51) [0012] "two resulting sub-images are offset by one half of a pixel in both horizontal 
and vertical directions") with respect to a corresponding pixel [0035] in the first image 
(fig. 6 and fig. 15 102 and 104..." 

10. In regards to claims 4-6, 10 and 1 1 it would have been an obvious matter of 
design choice to make the interpolating filter (fig. 1 (120, 140 and 160) Carlson) and 
filter coefficients (fig. 1 (120, 140 and 160) Carlson) fixed values, since such a 
modification would have involved a mere change in the size of a component. A change 
in size is generally recognized as being within the level of ordinary skill in the art. In re 
Rose, 105 USPQ 237 (CCPA 1955). 

Allowable Subject Matter 

11. Claims 16-19 are objected to as being dependent upon rejected base claims, but 
would be allowable if rewritten in independent form including all of the limitations of the 
base claim and any intervening claims. 
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12. Regarding claim 16, the major difference between the teachings of the prior art of 
record (Carlson US 6,650,704, Gibbon US PUB 2003/002089, and Young 
2003/0016292) and that of the instant invention is that said prior art of record does not 
teach generating an error image by subtracting the simulated image from the image 
data, and wherein the image processing unit is configured to generate fifth, sixth, 
seventh, and eight sub-frames using the error image and the first, the second, the third 
and fourth sub-frames. 

13. Regarding claim 17, the major difference between the teachings of the said prior 
art of record and that of the instant invention is that said prior art of record does not 
teach the system to generate first second, third and fourth correction sub-frames from 
the error image, wherein the image processing unit is configured to generate the fifth, 
the sixth, the seventh, and the eight sub-frames by multiplying each of the first, the 
second, the third, and the fourth correction sub-frames by a sharpening factor and 
adding the first, the second, the third, and the fourth sub-frames to the first, the second, 
the third and the fourth correction sub-frames, respectively. 

14. Regarding 18, the major difference between the teachings of the said prior art of 
record and that of the instant invention is that said prior art of record does not teach the 
system to generate a plurality of error data values by subtracting the simulated image 
from the image data, wherein the image processing unit is configured to generate an 
error image by convolving each of the error of the error data values with eight adjacent 
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error data values, and wherein the image processing unit is configured to generate fifth, 
sixth, seventh, and eighth sub-frames using the error image and the first, the second, 
the third, and the fourth sub-frames . 

1 5. Regarding 1 9, the major difference between the teachings of the said prior art of 
record and that of the instant invention is that said prior art of record does not teach the 
system to generate first, second, third, and fourth correction sub-frames from the error 
image, wherein the image processing unit is configured to generate the fifth, the sixth, 
the seventh, and the eighth sub-frames by multiplying each of the first, the second, the 
third, and the fourth correction sub-frames by a sharpening factor and adding the first, 
the second, the third and the fourth sub-frames to the first second, the third, and the 
fourth correction sub-frames, respectively. 

Conclusion 

42. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. US 6,825,835, US 2003/0016292, US 6,657,603, US 4,442,454 
US 2003/0133060, US 5,757,355, US 6,118,584, US 6,104,375, US 5,953,148 and 
5,742,274. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Grant D. Sitta whose telephone number is 571-270- 
1542. The examiner can normally be reached on M-F 9-6. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Amare Mengistu can be reached on 571-272-7674. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 
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December 21, 2007 




